Search for: All records

Abstract We document the propagation of annular modes—zonally symmetric patterns of variability—in Mars's atmosphere using a reanalysis dataset. Mars's Northern Annular Mode (MNAM) sees anomalies of zonal‐mean zonal wind emerge near the subtropics and migrate poleward with a period of 150 days, similarly to Earth's Southern Annular Mode. The mechanism of propagation involves the interaction of the two leading empirical orthogonal functions that define the MNAM. Moreover, the propagation encourages alternating bands of surface wind stress to migrate polewards with a 150‐day period. In addition, a 150‐day periodicity in anomalous column dust optical depth most likely emerges in response to extrema of the MNAM. The combination of the impact of the MNAM's internally forced periodicity on the surface wind stress and the seasonal cycle may contribute to the inter‐annual variability of global dust events, as suggested by a Monte Carlo estimate that correctly approximates the observed incidence of global dust events. 

Abstract We discuss the emerging advances and opportunities at the intersection of machine learning (ML) and climate physics, highlighting the use of ML techniques, including supervised, unsupervised, and equation discovery, to accelerate climate knowledge discoveries and simulations. We delineate two distinct yet complementary aspects: (a) ML for climate physics and (b) ML for climate simulations. Although physics-free ML-based models, such as ML-based weather forecasting, have demonstrated success when data are abundant and stationary, the physics knowledge and interpretability of ML models become crucial in the small-data/nonstationary regime to ensure generalizability. Given the absence of observations, the long-term future climate falls into the small-data regime. Therefore, ML for climate physics holds a critical role in addressing the challenges of ML for climate simulations. We emphasize the need for collaboration among climate physics, ML theory, and numerical analysis to achieve reliable ML-based models for climate applications. 

Abstract There are different strategies for training neural networks (NNs) as subgrid‐scale parameterizations. Here, we use a 1D model of the quasi‐biennial oscillation (QBO) and gravity wave (GW) parameterizations as testbeds. A 12‐layer convolutional NN that predicts GW forcings for given wind profiles, when trained offline in abig‐dataregime (100‐year), produces realistic QBOs once coupled to the 1D model. In contrast, offline training of this NN in asmall‐dataregime (18‐month) yields unrealistic QBOs. However, online re‐training of just two layers of this NN using ensemble Kalman inversion and only time‐averaged QBO statistics leads to parameterizations that yield realistic QBOs. Fourier analysis of these three NNs' kernels suggests why/how re‐training works and reveals that these NNs primarily learn low‐pass, high‐pass, and a combination of band‐pass filters, potentially related to the local and non‐local dynamics in GW propagation and dissipation. These findings/strategies generally apply to data‐driven parameterizations of other climate processes. 

Abstract Atmospheric gravity waves (GWs) span a broad range of length scales. As a result, the un‐resolved and under‐resolved GWs have to be represented using a sub‐grid scale (SGS) parameterization in general circulation models (GCMs). In recent years, machine learning (ML) techniques have emerged as novel methods for SGS modeling of climate processes. In the widely used approach of supervised (offline) learning, the true representation of the SGS terms have to be properly extracted from high‐fidelity data (e.g., GW‐resolving simulations). However, this is a non‐trivial task, and the quality of the ML‐based parameterization significantly hinges on the quality of these SGS terms. Here, we compare three methods to extract 3D GW fluxes and the resulting drag (Gravity Wave Drag [GWD]) from high‐resolution simulations: Helmholtz decomposition, and spatial filtering to compute the Reynolds stress and the full SGS stress. In addition to previous studies that focused only on vertical fluxes by GWs, we also quantify the SGS GWD due to lateral momentum fluxes. We build and utilize a library of tropical high‐resolution (Δx = 3 km) simulations using weather research and forecasting model. Results show that the SGS lateral momentum fluxes could have a significant contribution to the total GWD. Moreover, when estimating GWD due to lateral effects, interactions between the SGS and the resolved large‐scale flow need to be considered. The sensitivity of the results to different filter type and length scale (dependent on GCM resolution) is also explored to inform the scale‐awareness in the development of data‐driven parameterizations. 

Abstract Transfer learning (TL), which enables neural networks (NNs) to generalize out-of-distribution via targeted re-training, is becoming a powerful tool in scientific machine learning (ML) applications such as weather/climate prediction and turbulence modeling. Effective TL requires knowing (1) how to re-train NNs? and (2) what physics are learned during TL? Here, we present novel analyses and a framework addressing (1)–(2) for a broad range of multi-scale, nonlinear, dynamical systems. Our approach combines spectral (e.g. Fourier) analyses of such systems with spectral analyses of convolutional NNs, revealing physical connections between the systems and what the NN learns (a combination of low-, high-, band-pass filters and Gabor filters). Integrating these analyses, we introduce a general framework that identifies the best re-training procedure for a given problem based on physics and NN theory. As test case, we explain the physics of TL in subgrid-scale modeling of several setups of 2D turbulence. Furthermore, these analyses show that in these cases, the shallowest convolution layers are the best to re-train, which is consistent with our physics-guided framework but is against the common wisdom guiding TL in the ML literature. Our work provides a new avenue for optimal and explainable TL, and a step toward fully explainable NNs, for wide-ranging applications in science and engineering, such as climate change modeling. 

Abstract Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models, if trained on observations can mitigate certain biases in current state-of-the-art weather models, some of which stem from inaccurate representation of subgrid-scale processes. However, these data-driven models, being over-parameterized, require a lot of training data which may not be available from reanalysis (observational data) products. Moreover, an accurate, noise-free, initial condition to start forecasting with a data-driven weather model is not available in realistic scenarios. Finally, deterministic data-driven forecasting models suffer from issues with long-term stability and unphysical climate drift, which makes these data-driven models unsuitable for computing climate statistics. Given these challenges, previous studies have tried to pre-train deep learning-based weather forecasting models on a large amount of imperfect long-term climate model simulations and then re-train them on available observational data. In this article, we propose a convolutional variational autoencoder (VAE)-based stochastic data-driven model that is pre-trained on an imperfect climate model simulation from a two-layer quasi-geostrophic flow and re-trained, using transfer learning, on a small number of noisy observations from a perfect simulation. This re-trained model then performs stochastic forecasting with a noisy initial condition sampled from the perfect simulation. We show that our ensemble-based stochastic data-driven model outperforms a baseline deterministic encoder–decoder-based convolutional model in terms of short-term skills, while remaining stable for long-term climate simulations yielding accurate climatology. 

Abstract The variability of the Southern Hemisphere (SH) extratropical large‐scale circulation is dominated by the Southern Annular Mode (SAM), whose timescale is extensively used as a key metric in evaluating state‐of‐the‐art climate models. Past observational and theoretical studies suggest that the SAM lacks any internally generated (intrinsic) periodicity. Here, we show, using observations and a climate model hierarchy, that the SAM has an intrinsic 150‐day periodicity. This periodicity is robustly detectable in the power spectra and principal oscillation patterns (aka dynamical mode decomposition) of the zonal‐mean circulation, and in hemispheric‐scale precipitation and ocean surface wind stress. The 150‐day period is consistent with the predictions of a new reduced‐order model for the SAM, which suggests that this periodicity is associated with a complex interaction of turbulent eddies and zonal wind anomalies, as the latter propagate from low to high latitudes. These findings present a rare example of periodic oscillations arising from the internal dynamics of the extratropical turbulent circulations. Based on these findings, we further propose a new metric for evaluating climate models, and show that some of the previously reported shortcomings and improvements in simulating SAM's variability connect to the models' ability in reproducing this periodicity. We argue that this periodicity should be considered in evaluating climate models and understanding the past, current, and projected Southern Hemisphere climate variability.